Papers with quality assessment learning mechanism
TAeKD: Teacher Assistant Enhanced Knowledge Distillation for Closed-Source Multilingual Neural Machine Translation (2024.lrec-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have produced impressive results in the field of Multilingual Neural Machine Translation (MNMT). |
| Approach: | They propose a Teacher Assistant enhanced Knowledge Distillation method to augment knowledge transfer capacity from closed-source MNMT models. |
| Outcome: | The proposed method outperforms the state-of-the-art KD methods on both WMT22 and FLORES-101 test sets. |